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(54) A computer controlled telephone apparatus 



(57) 



A telephone apparatus is disclosed, comprising: 
a telephone set 1 for implementing telephony actions on a telephone line, said telephone set including a 
serial interface 9 for bidirectional communication of data signals; and 

a computer executable software application for receiving first ones of said data signals frorti said 
telephone set and in response implementing predetermined software functions, and for transmitting further 
ones of said data signals to said telephone set in response to a user input whereupon said telephone set 
implements predetermined ones of said telephony functions. The serial link is either a Universal Serial Bus 
(USB) or an RS-232 link. The controlling software operates in a windows type environment and telephone 
functions are controlled on-screen using drop-down menus, on-screen buttons and icons. 
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At least one drawing originally filed was informal and the print reproduced here is taken from a later filed formal copy. 
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C3 Assistant 



The Personal Assistent helps 
handle your calls 



Apply 



Close 



Call Screening [ Call Blocking Greetings Personal Messages 



With Call Screening you can have the Personal Assistant let only 
the people in your Call Screening list ring through on incoming 
calls. All other callers will be sent to voicemall. 



r~i Call Screening is sn 



Do you wish to add the cun-ent 
caller to the Call Screening list? 



Add to Call Screening List 



Qpen Call Screening List 
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C] Assistant 



n-j The Personal Asslstent helps 
^ handle your calls 




® '^us^tf othel'^lle.s will be sent to voicema,!. 



Q Call Screening is on 



Do vou wisli to add the current 
caller to the Call Screening list? 



I Add to Call Screening List~| 
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C3 Assistant 



^ The Personal Assistant helps 
handle your calls 



Apply 



Close 



Call Screening Call Blocking Greetings Eersona! Messages 



Set-up the voicemail message your callers hear in three parts, 
m First record how you want to greet them, next let them know your 
^ status and finally instruct them on what to do next. 



"Hi, you've reached ABC 
Limited." 



Default Greeting 



Test initial greeting 



My Status 



"We can't get to the 
phone right now." 



"Please leave a 
message at the tone." 



[None] 




instructions 


Test instructions 





Sounds 
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SYSTEM FOR INTERACTIVE CONTROL OF COMPUTER AND TELEPHONE 
Field of the Invention 

This invention relates in general to personal computers and telephony, and 
more particularly to an interactive system by which a computer and telephone 
function cooperatively to implement a multiplicity of functions invoked by a u3cr. 

Background of the Invention 

Software applications are known in the art for implementing telephony 
features using a personal computer. According to existing First Party Call Control 
architectures, a physical coimection is provided between the telephone and personal 
computer for providing Computer Telephony Integration (CTI)- Such prior art CTI 
architectures have suffered from extreme limitations in functionality and ease of use. 
For example, in order to place a phone call, a tiser typically must first close or 
minimize whatever jqpplicadon he or she is currently running (eg. Microsoft Word®), 
open the CTI application, enter the digits to be dialled via point-and-click numbers, 
and then click an accept or dial button. Alternatively, according to some CTI 
architectures, the user is able to navigate or browse a telephone directory in order to 
identify the party to be called and then« once located, highlight the party's name and 
click a dial button. 

Understandably, the awkwardness of using such systems and the limited 
features provided thereby have led some consumers to abandon prior art CTI systems 
in &vour of more functional telephone sets or even *'plain old telephone sets" (POTS) 
with enhanced features being provided by the central office. 

One of the reasons for the awkwardness and limited functionality of prior art 
CTI architectures is that there is no seamless integration of ftmctions activated by the 
telephone and functions activated directly or indirectly by the computer. 

Recent developments in the standardization of computer inter&ces have led to 



increased development of software applications which are adapted to integrate 
functionality of a personal computer with various and diverse external devices. For 
example, the recently established standard for USB (Universal Serial Bus • a 12 
Mbit/s serial interface running over a four wire bus, with an associated software stack 
supporting peripheral connectivity to a personal computer) is expected to yield a raft 
of software applications which interact cooperatively with external devices ranging 
from video games to faxes and data modems. 

An object of the present invention is to provide an interactive telephone and 
PC-based software application ^ch will overcome the limitations of prior art CTI 
architectures and be compatible with emerging standardized interfaces such as USB. 

Summary of the Invention 

According to the present invention^ an interactive system is provided by which 
a computer and telephone function cooperatively to implement a multiplicity of user- 
invoked features. Physically, the system comprises a telephone set which is 
connected to a personal computer on which a novel TAPI (Telephony Application 
Program Interfece) application is executed- The telephone set includes a plurality of 
user-definable function keys in addition to the keypad, handset, speaker phone and 
other standard components. The user-definable function keys are programmable via 
the computer to implement specific telephony features or to launch applications on 
the computer. The TAPI application permits shared and interactive functionality 
between the computer and telephone set including, but not limited to, call 
manag ement, call logging, call recording, phonebook database creation and editing, 
and dialling. The telephone set is cormccted to a single central office line, and can be 
connected to the computer via eitiier a USB or a standard RS-232 serial line. 

The TAPI £43plication accortiing to the present invention comprises a plurality 
of user interface components for user display and printing, and a plurality of engine 
components for call processing, data storage and manipulation, application 
configuration management and audio recording and playback. The engine 



3 

components arc located in one or more Dynamic Link Libraries (DLLs) to provide the 
necessary information for display or printing by the user interface components. The 
user interface components are contained in a main executable file and arc isolated 
from the non-user or engine components to allow for flexibility in future interface 
5 developments- 

The user interface components of the present invention provide a graphical 
user inteifece (GUI) characterized by a number of usefid features. According to one 
aspect of the GUI, a **flyout" control bar may be activated by the user to display 

1 0 various context sensitive call features. According to another aspect, where caller line 

identification data (CLID) is sent to the user's system, the caller's picture is displayed 
on-screen as a bit map, along with the user's name and telephone ntmiber. According 
to an additional aspect, the user can program a plurality of custom diallers which 
operate in a manner somewhat similar to speed diallers except that the diallers are 

1 5 logically sequenced by the user for navigating automated attendants and other 

comparable call answering systems. 

Brief Descriptjon of the Drawings 

20 A detailed description of the preferred embodiment is provided herein below 

with reference to the following drawii^, in which: 

Figure 1 is a schematic illustration of the comptiter-based telephony system 
according to a general aspect of the present invention; 

25 

Figure 2 is a block diagram showing software modules which form the 
protocol stack governing conmiunication between the telephone set and computer of 
the telephony system according to the present invention; 

30 Figure 3 shows a main windcfw display generated by the software application 

according to a first embodiment of the present invention; 



Figure 4 shows the main window display of Figure 3 with a flyout control bar 
thereof in the open position; 

Figures 5a though 5c show the main window display according to an 
alternative embodiment of the present invention, wherein Figtare 5a shows the main 
window display with toolbar showing, and Figures 5b and 5c show the main window 
display with control bar actuator positioned n the right and left, respectively; 

Figures 6a though 6c show a receptionist icon or indicator of a status line of 
the main window according to the first embodiment; 

Figures 7a though 7c show a voicemail icon or indicator of the status line of 
the main window according to the first embodiment; 

Figures 8a though 8d show a "Do Not Disturb*' icon or indicator of the status 
line of the main window according to the first embodiment; 

Figure 9 is a block diagram showing user interfiu:e components of the 
software application and engine components of the core software module executed by 
the computer according to the present invention; 

Figures 10 shows the main window display of the first embodiment in the 
event of an incoming call (Figure 10a), with the control bar in the open position 
(Figure 10b), and with the Phone menu open (Figure 10c), whereas Figure lOd shows 
the main display according to the alternative embodiment; 

Figure 1 1 shows the main window display according to the first embodiment 
when an incoming call is sent to voice mail (Figure 1 1 a), with the control bar in the 
open position (Figure 1 lb), and with the Phone menu open (Figure 1 Ic); 

Figure 12 shows the main window display according to the first embodiment 
when a voice mail message is being recorded (Figure 12a) and the user picks-up the 
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call (Figure 1 2b); 

Figure 13 shows the main window display according to the first embodiment 
when a call is diverted to hold; 

5 

Figure 14 shows the main window display according to the first embodiment 
during a hang-up sequence beginning with the user hanging up (Figure 1 4a), the call 
state being indicated as "Hanging Up" (Figure 14b), and finally the call state being 
indicated as **Your Line is Free'' (Figure 1 4c); 

10 

Figure 15 shows the main window display according to the first embodiment 
during a direct dial sequence beginning in the idle state with the user clicking the 
"Make a calT default button (Figure ISa), followed by positioning of the cursor over 
the Number field and the call state being indicated as ''Enter a phone number^* (Figure 
1 5 1 5b), entering of dial digits (Figure 1 5c), and finally upon a match between the 

entered dial digits and a number stored in the Phonebook^ the called party's name is 
displayed along with a call timer for the duration of the call (Figure 15d); 

Figure 16 shows the main window display according to the first embodiment 
20 during an on-hook dial sequence beginning in the idle state (Figure 16a), followed by 

positioning of the cursor over the Number field and entering of dial digits (Figure 
I6b), as digits axe entered, if a match is fotmd in the Phonebook, the name of the 
person being called is displayed in the Name field (Figure 16c), clicking of the ''Make 
a Call^ icon appearing in the de&ult button (Figure 16d), and finally initiating the call 
25 and displaying the call timer (Figure 1 6c); 

Figure 17 shows the main window display according to the first embodiment 
during a dial by name sequence begirming in the idle state (Figure 17a), followed by 
positioning of the ctusor over the Name field and entering of letters of the name of the 
30 person to be called (Figure 17b), as letters are entered, if a match is found in the 

Phonebook, the name and de&ult telephone number of the person being called are 
displayed (Figure 17c), selecting a different phone number for the person being 



called, from a drop-down list (Figure I7d), clicking of the ''Make a Call" icon 
appearing in the default button (Figure 1 7e), and finally initialing the call and 
displaying the call timer (Figure 1 7£); 

Figure 1 8 shows the main window display according to die first embodiment 
during a speed dial sequence beginning in the idle state with the user selecting a "Dial 
"menu item fix)m the menu bar (Figure 1 8a), selecting a name and number from the 
"Speed Dial*' list Figure 1 8b), displaying the selected name and number are displayed 
(Figure 1 8c), initiating the call and displaying the call timer (Figure 1 8d); 

Figure 19 shows die main window display according to the first embodiment 
during a drag-and-drop name search and dial sequence, beginning in the idle state 
(Figure 19a), highlighting and dropping a portion of text from another appUcation into 
the Name field such that the Phonebook is automatically searched and in response to a 
match the default number associated witii the matched name is displayed in die 
Number field (Figure 1 9c), clicking on the defeult button resulting in a line being 
selected and digit out-pulsing (Figure 19d), and once the dialling is complete, display 
of the call timer (Figure 19e>; 

Figure 20 shows the main window display according to the first embodiment 
during a hang up, beginning with cUcking on the "Hang Up" icon of the defeult 
button (Figure 20a), displaying a "Hanging Up' message (Figure 20b), and finally 
retumii^ to the idle state (Figure 20c); 

Figure 2 1 shows an extension in use indicator of the main window display 
according to the first embodiment; 

Figure 22 shows the main window display according to the first embodiment 
during a sequence of adding a party to the Phonebook fiom the connected state 
(Figure 22a) where the user activates the control bar (Figure 22b), and therefrom 
activates a Phonebook window (Figure 22c) from which a Profile window can be 
activated (Figure 22d); 
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Figure 23a shows a Work tab of the Profile window, a Home tab is shown in 
Figure 23b, a Phone tab is shown in Figure 23c, a Personal tab is shown in Figure 23d 
and a Shortcuts tab is shown in Figure 23e; 

5 Figure 24 shows the main window sequence according to the first embodiment 

for playing a voicemail message from the idle state with a message waiting icon 
flashing (Figure 24a), with a tooltip indicating the number of messages waiting 
(Figure 24b), with a shortcut mouse click to open voicemail (Figure 24c) and 
displaying the voicemail subdirectory of a Call Log and superimposed recorder 

10 window; 

Figure 25 shows various window displays indicating operation of a user 
customizable dialler feature according to the first embodiment, wherein Figure 2Sa 
shows access to the dialler feature via the Tools menu of the main window. Figure 
1 5 25b shows a series of user defimed categories or sections of the dialler. Figure 25c 

shows a particular section in an open state, and Figure 25d shows an editing feature 
for a selected button; 

Figure 26 shows a Personal Assistant window according to the alternative 
20 embodiment including a plurality of tabs identified as Call Screening (Figure 26a), 

Call Blocking (Figure 26b), Greetings (Figure 26c) and Personal Messages (Figure 
26d); 

'^Figures 27a through 27f show a configuration window having multiple user 
25 selectable tabs for configuring the telephone and application^ wherein Figure 27a 

showrs a Soimds tab. Figure 27b shows an Incoming Calls tab. Figure 27c shows an 
Audio Devices tab, and Figure 27d shows a Function Buttons tab. Figure 27e shows a 
Voicemail tab, and Figure 27f shows a Miscellaneous tab; and 

30 Figure 28 shows a Sound Manager window for effecting soimd recording and 

editing.. 
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Detailed Description of the Preferred Embodiment 

Turning to Figure 1, the computer-based telephony system of the present 
invention is shown in its broadest aspect comprising a telephone set 1 connected to a 
telephone switching system 3 (e.g. central office) via a telephone line 5. The 
telephone set 1 is also connected to a personal computer 7 via a serial link 9. The 
personal computer 7 includes a monitor or display 8 as well as a mouse pointer 10 and 
keyboard 12» in a well known manner. According to the pxeferred embodiment, the 
serial link is one of either a USB or RS-232 line, although other suitable data 
conmiimication links are possible. The computer 7 executes a TAPI compliant 
software application for communicating with the telephone set 1 to implement various 
telephony functions, as discussed in greater detail below. 

The telephone set 1 includes a handset 1 1 and keypad 13, and in addition 
includes a plurality of programmable function keys 15. As discussed in greater detail 
below, respective ones of the function keys may be programmed via the software 
application executed on computer 7 to activate predetermined telephony functions or 
software functions on the computer. For example, in one scenario a function key may 
be programmed to automatically activate a "Do Not Disturb'' feature while in another 
scenario the function key may be programmed to launch a software application such 
as Nficrosoft Word®. The set 1 also includes a message waiting lamp 16 which is 
activated by the software application to notify the caller of an incoming message, 
which can be a voicemail message, a &x, Internet email or other multimedia message. 

As indic at ed above, the software application nmning on computer 7 
communicates with telephone set 1 via serial link 9. As shown in Figure 2, in order 
for this commimication to take place, data must pass through a plurality of modules 
^^ch form a protocol stack between the application 1 7 and telephone set 1 . The 
telephone set 1 incorporates a microprocessor 19 (e.g. Intel 80930) with Flash 
EPROM memory 2 1 . A modem 23 is connected to microprocessor 1 9 and is also 
provided with a Flash memory 25. The microprocessor 19 and modem 23 together 
control implementation of standard telephony functions such as incoming call. 



outgoing call call waiting, speaker phone conversation, hold, etc., in a well known 
manner. However, in accordance with the principles of the present invention, the 
software application 17 is able to interact with the telephone set 1 to cooperatively 
implement a mtdtiplicity of user-invoked featm^s. 

5 

Although the software modules comprising the protocol stack do not form part 
of the present invention, a brief description is provided herein for completeness. The 
highest level in the stack is represented by the software application 17 which 
comprises a plurality of user interlace components for display and printing 

1 0 functionality, as discussed in greater detail below with reference to Figure 9. 

Immediately below the application 17 is a core 27 comprising a plinality of engine 
components for providing all of the support which the user intcrfece components 
require to display and print data. This support includes call processing, data storage 
and manipulation, application configuration management and audio recording and 

1 5 playback. The engine components are located in one or more DLLs with 

language inter&ces to them, as discussed in greater detail below. 

According to the preferred embodiment as of the filing date of this application, 
the application 17 is coded in VisualBasic whereas the core 27 of engine components 
20 is coded in C++. To &cilitate access from VisualBasic to the DLLs, an OCX layer 29 

is provided. The OCX layer 29 is also coded in C++. 

Below the OCX layer is TAPI layer 3 1 , which is a Microsoft device 
independent communication library created by Microsoft for use by programmers 
25 writing telephony applications (including data, tax and voice modem) for Microsoft 

operating systems. 

Below TAPI layer 3 1 is a TAPI service provider referred to as 
"Musmdm.Tsp*' layer 33. This layer conmnmicates with Microsoft's 
30 ^'UnimodemA^.Tsp" and "UnimodemA^.Vxd** layers 35 and 37, respectively, which 
forai the standard Windows 95® low-level software architecture for supporting 
telephony applications utilizing voice/data/fex modems. 
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The "Unimodem/V.Vxd" layer 37 communicates with aMiteKVxd layer 39 
which provides an interface to the standard VCOM layer 41 . VCOM layer 41 is a 
static VxD which is loaded when booting Windows 95, and which fimctions as a 
device driver interfece to the devices connected to serial link 9 (ie. USB or RS-232 
port drivers). 

Since the UniModem V architecture docs not support a number of essential 
telephony signals, such as keypad, hookswiteh, hold, etc., a 16 bit/32 bit "thunking 
layer** 43 is provided for circumventing the UniModem V layers for these signals. 

At the lowest levels of the protocol stack, VCOM layer 41 communicates with 
one of either with a VCOM mapper 45 for the USB version of this invention or a 
VCOM port driver referred to as MSerial.Vxd 47. 

For the USB version, VCOM mapper 45 commimicates with a USB device 
driver "musb.sys" 49 for causing the USB to "appear^ as a serial port The 
*'musb.sys" driver 49 communicates the standard Microsoft USB stack and associated 
hardware 5 1 for transmitting and receivii^ serial data via the USB. 

For the RS-232 version, the MSerial.Vxd driver 47 communicates with a 
UART 53 (Universal Asynchronous Receiver Transmitter) in a well known manner. 

At the telephone set 1, the USB hardware 5 1 communicates directly with 
microprocessor 19 via associated USB hardware incorporated into the 
microprocessor, whereas for the RS-232 version UART 53 communicates with a 
fuither UART 55 connected to the microprocessor 19. 

As indir?**^ above, the user inter&ce components of application 1 7 are 
responsible for unplementing a Graphical User hiterfece (GUI) which aUows the user 
to access various software and telephony features. The principal user interfece to 
these feanires is provided by the main window 57 which is depicted via display 8 of 
computer 7. Two embodiments of the GUI are discussed herein. A first embodiment 
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is initially shown in Figure 3 while an alternative embodiment is initially shown in 
Figure 5. The basic user functionality provided by the two embodiments is similar. A 
detailed description of the functionality is described herein in detail with reference to 
the first embodiment, and supplemented where appropriate with reference to the 
alternative embodiment- As of the dale of initial filing of this application, the second 
embodiment constitutes the best mode, the operation of which will be understood by a 
person of ordinary skill in the ait having reference to the detailed description of the 
first embodiment supplemented by reference to the second embodiment disclosed 
herein. 

The mam window display according to the first embodiment (Figure 3), 
includes a title bar 59 with document control menu icon as well as minimiz e and close 
buttons, a customizable toolbar 60 with volume, speaker, microphone, voicemail. 
profile, phonebook, call log and help buttons showing, a display area 61 with name 
field, number field and call state information, a context sensitive default bunon 63 
v^rhich has focus and responds to the "Entef' key fit)m the keyboard of computer 7 
(unless the focus is changed by the user), 2l control bar actuator 65, a menu bar 67, 
resize control 69, and a status line 71 with indicators including receptionist icon 73, 
voicemail icon 75 and "Do Not Disturb" icon 77. 

A horizontal control bar 79 can be opened ftom the main window display 57, 
as shown in Figure 4. The control bar 79 opens when the screen pointer of mouse 10 
passes over the control bar actuator 65 (similar to the auto hide/show feature of the 
Windows 95® task bar), and can be programed to open automatically in the event of 
an incoming call at telephone 1 . According to one embodiment of the invention a time 
delay is provided (e.g. 0.2 sees) after positioning the mouse pointer over the actuator 
65, in order to prevent accidental inadvertent opening of the control bar 79. The 
control bar 79 remains open as long as mouse pointer 10 is positioned over any one of 
the fimction buttons 81 . Preferably, a time delay is provided (e.g. 0.5 sees.) after the 
mouse pointer 10 has moved from the control bar 79 before the control bar is closed. 
The control bar 79 may also be opened using a keyboard sequence (such as Alt+m). 
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In the event that the user drags the main window display 57 to the right side of 
display 8 so that there is no longer sufficient room for the control bar 79 to open to 
the right, the control bar and associated default button 63 swap positions with the 
display area 61 and the control bar opens to the left of the main window display 57. 
This feature of the invention is shown in Figure 5b and 5c, which show the main 
window display 57 according to the alternative embodiment 

The control bar 79 provides a normally hidden menu of function buttons 81 to 
the user. The buttons 8 1 are preferably labelled with icons and text By keeping the 
control bar 79 closed during nomial operation, considerable screen real estate is 
saved* Opening of the control bar 79 provides the user with immediate access to call 
handling features without having to scroll through a multitude of menus or buuons, 
waiting for tool tips to pop-up, etc., as is conmion with prior art CTI applications. 
Furthermore, according to an important aspect of the invention, the default buuon 63 
and buttons 8 1 of the control bar 79 are context sensitive so as to provide 
functionality derived fix)m all parts of the software application 17, but only function 
options which are appropriate to the state of the telephone call (e.g. when a call is in 
progress, as shown in Figure 4, the options are Hang Up, Hold, Recorder and Open 
File). 

According to the embodiment shown in Figure 3, the options of menu bar 67 
include: 

I) a File menu for providing access to hnport and Expon functions (e.g. links 
to contact lists from other PIMs, etc.), and an Exit conunand which quits the 
application 17; 

ii) an Edit menu which provides access to well known cut, copy, paste and 
delete commands, which may be used to modify both the name and number fields of 
display are 61; 

iii) a View menu which allows the user to hide or show the toolbar 60 within 
main window 57; 

iv) a Phone menu for presenting various telephony function options to the 
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user for call handling - as with the default buuon 63 and function buttons 8 1 
discussed above, the telephony function options presented in the Phone menu are 
made context sensitive by dimming commands which are not appropriate to the 
telephone call state; 

v) a Dial menu which presents the user with a list of user definable important 
or frequendy dialled numbers as well as a Calls Made list and Calls Received list -the 
Dial menu including: 

- a Speed Dial sub^menu defined by the user in the phonebook such that for 
each person in the list, all relevant phone numbers are displayed. Upon 
selection of a phone number, the name and number are dropped in display area 
61, the telephone 1 goes ofi-hook and digits are immediately out-pulsed; 

. a Calls Made sub-menu for providing the user with a list of the last 20 people 
who were called, sorted by date and time, with the last person called appearing 
at the top of the list; 

- a Calls Received sub-menu for providing the user with a list of the last 20 
people who called, sorted by date and time. 

vi) a Tools menu 74 (see Figure 25a) for providing the user with access to 
advanced features of the application 17, such as: 

- a Phonebook sub-menu for providing the user with access to various 
phonebook functions and directories; 

- a Messi^es sub-menu for providing the user with access to messagix^ 
functions, greetings as well as voicemail messages left for the user in the Call 
Log (discussed below); 

- a Call Log siib-menu i^ch opens the user's call log, (discussed below); 

- a Call S cr ee n ing menu the call screening function on or ofif (i.e. sending 
incoming calls, except those in the Call Screen folder of the phonebook, to 
voicemail without disturbing the user; 

- a Recorder menu item for opening the Recorder window for recording a 
conversation; 

- a Diallers sub-menu for providing a list of user defined buttons ^^ch can be 
used for speed-dialling or navigation (discussed in greater detail below). 
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The options of Menu bar 67 according to the embodiment of Figure 5 
similar, except that there are no View and Dial menu items. 



are 



As indicated above, and as shown in Figures 6a to 6c, the status line 71 
includes a receptionist icon 73 for indicating that the receptionist function is active 
meaning that advisory messages and personal messages are automatically played for 
specific callens based on CUD. As shown in Figure 6b, when the mouse pointer 10 
enters the bounding box of receptionist icon 73. a tool tip box 78 opens displaying the 
current message to be played for incoming caUers who are sent to voicemail. A right 
mouse button click when the mouse pointer 10 is over the receptionist icon 73 opens a 
shoitcut menu 80 for selecting advisory messages, as shown in Figure 6c. 

In the alternative embodiment shown in Figures 5a through 5c, the receptionist 
icon 73 appears as a button for implementing predetermined features such as caU 
scrremng. caU blocking, greetings and personal messages, aU of which are discussed 
in greater detail below. 



The status line 7 1 also includes a voicemail icon 75 viiich functions as a 
messages indicator to alert the user to any new voicemail messages. Asshownin 
Figures 7a to 7c, when messages are waiting the icon flashes (Figure 7a). As shown 
in Figure 7b, when the mouse pointer 10 enters the bounding box of voicemail icon 
75. a tool tip box 82 opens displaying the number of new messages. A tight mouse 
button click when the mouse pointer 10 is over the voicemaU icon 73 opens a shoitcut 
menu 84 for accessing voicemail messages, as shown in Figure 7c. A double click 
opens the voicemail folder of the CaU Log, as discussed in greater detail below. 

A "Do Not Disturb" icon 77 is included in the status line 71. as shown in 
greater detaU with reference to Figures 8a to 84 TTie "Do Not Disnirb" icon 77 alerts 
the user that some or aU caUers are being prevented fiom calling in (see Figure 8a), 
As shown in Figure 8b, when the mouse pointer 10 enters the bounding box of "Do 
Not Disttirb" icon 77, a tool tip box 86 opens displaying the stanis of Call Screen. A 
right mouse button click when the mouse pointer 10 is over the voicemail icon 73 
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opens a shortcut menu 88 for luming the Call Screen function on or off, as shown in 
Figure 8c, while a double click toggles between the on/off states. Figure 8d shows 
the icon 77 indicating that Call Screen is off. 

5 In the alternative embodiment of Figure 5, a bell icon 72 is provided for 

opening a sound manager window for creating or changing sounds and assigning 
predetemiined soimds to different functions, as discussed in greater detail below. 

Turning now to Figure 9, the user inter&ce components of software 
1 0 application 17 and the engine components of core 27 are shown in greater detail. All 
commimications between the engine components and the user inter&ce components 
are provided through a main window component 83. The main window component 83 
displays the main vydndow display 57 including menu bar 67, toolbar 60, status line 
71, display area 61 and default button 63, as discussed above. If the data being 
1 5 communicated by the core 27 is intended for a user interface component other than 

the main window component 83, the main window component routes it appropriately. 

A display window component 85 functions in conjunction with the main 
window component 83 to generate display area 6 1 for showing line and call 
20 information. 

Flyout menu component 87 displays the context-sensitive control bar 79 for 
providing push-button-style menu selections. 

25 The application configuration dialog 89 and phone configuration dialog 9 1 , in 

combination allow the user to configure the software application, as discussed in 
greater detail below with reference to Figure 27. 

The group editor 93 allows the user to manipulate entries in a Call Screening 
30 list. Call Blocking List or Speed Dial list, as discussed in greater detail below. 

The directory component 95 displays information relating to the user's 
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business and personal contacts. The Phonebook is analogous to a Personal 
Information Manager (PIM). The Phonebook display is discussed in greater detail 
below with reference to Figure 23, and contains the following tabs: 
Home * Name and home address 

Work - Name, company name, type of contact and business address 

Phone Numbers - Home, business, fax and cellular phone numbers 

Personal - User selectable greeting and message preferences 

Notes - Editor OCX that supports sound objects 

Shortcuts - Window with preferred application icons (e.g. Microsoft 

Word®, Excel®, etc.) which are automatically opened when 
the contact is called or when the contact calls 

The user can configure programmable icons using the programmable icons 
dialog 97. These icons can be programmed to access CO voicemail and IVR systems. 

The voice record dialog 99 allows the user to record greetings and other voice 
recordings. 

The retrieve voicemail dialog 101 is used to access voicemail messages. 

The call log 103 is used to display all telecommunications activity fiom the 
application 17. 

The about box 105 displays application version infomiation and current 
system statistics, in a conventional manner. 

When the user wishes to play a voice mail message from Microsoft 
Exchange®, a Microsoft Exchange UI application 107 is invoked, (user intei&ce). 
This ^plication displays controls to play, stop, rewind and fast forward the message. 

The tray icon 109 appears in die Windows 95® task bar. When this icon is 
selected, the tray window is displayed. The tray window provides access to basic 
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functions of the application 17. 

Turning now to the engine components of core 27, call manager 111 maintains 
call-specific data for all existing calls on all lines. The call manager 1 1 1 uses TAPI to 
obtain the call-specific information it requires. For each call, the following data is 
stored: 

1. TAPI call handle 

2. call state 

3. whether the call is incoming or outgoing 

4. v^iether the call should be blocked (for incoixiing calls) 

5. whether the call should be screened (for incoming calls) 

6. digits dialled, name of person called (for outgoing calls) 

7. caller ED number and name (for incoming calls) 

8. call start time, call duration 

9. DTMF digits received (for incoming calls) 

The line manager 113 maintains line-specific data for all available telephone 
lines. It inter&:es to TAPI 3 1 to perform line-related requests. The line manager 
facilitates multi-line support in the application 17. For each line, it stores the 
following data: 

1. TAPI line handle 

2. line state 

3. feature supported by the line 

4. cotmt of rings for an unanswered incoming call 

5. existing calls on the line (actual data is maintained by call manager 1 1 1) 

6. number of rings to wait before answering incoming calls 

7. voice mail on/off state 

Line manager 133 also perfomis the following line-related requests: 
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1 . dial number 

2. hang up 

3 . answer incoming call 

The line m ana g er 1 13 contains a TAPI callback to receive line-specific 
notifications from TAPI layer 3 1 . 

The phone manager 1 15 maintains data that is specific to the telephone 1. It 
interfaces to TAPI layer 3 1 to perform phone-related requests. The data maintained 
by phone manager 1 15 includes: 

L status of lamp 16 

2. hookswitch status 

3. phone button data 

The phone manager 1 15 also contains a TAPI callback to receive telephone- 
specific notifications from TAPI layer 3 L 

During operation^ the telephone 1 needs to know when the application 17 is 
active. When the application is not active, the telephone 1 reverts to a regular POTS 
telephone and the programmable buttons 15 lose their functionality. In order to 
detcmunc whether the application 17 is active, the telephone 1 attempts to send a so- 
called *are you aUve?' message to the phone manager 1 1 5. The phone manager then 
responds with the appropriate reply. 

The call control manager 1 17 manages ail incoming and outgoing telephone 
calls in conjunction with the line manager 113, call manager 11 land phone manager 
1 15 to access telephony fimctionaUty. The line and phone managers forward required 
call progress events which they receive from TAPI 3 1 to the call control manager 
1 1 7. The call control manager 1 1 7 also manages any audio playback which may be 
required for a call. 
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The database manager i 19 provides an interface to the databases 120 stored 
on disk in computer 7. The databases 120 are preferably stored in Microsoft Jet 
format (.MDB). This manager's interfece is independent of the database technology 
being used. The database manager 1 19 supports the following functionality: 

1 . open and close databases 

2. read and write database table data 

3 . perform database queries 

The smart data access manager 121 provides intelligent access and 
modification capabilities to all data required by the engine components of core 27 
(excluding user preference data). For simplicity, the user inter&ce components of 
application 1 7 may implement the data access functionality they require. For the best 
mode of this invention as of its filing date, the user interface components are written 
in VisualBasic®, so that the task of implementing data access functionality required is 
simplified and results in saving the overhead of passing large amounts of data 
between the database and the engine components and then between the engine 
components and the user inter&ce components. The smart data access manager 121 
uses the database manager 119 to read and write data that is stored in the databases 
120. 

The smart data access manager 121 siqiports the following fimctionality (or 
the subset of this functionality that only the engine components require): 

1. read/write call log data 

2L get Last Number Rediai list 

b. get Calls Axiswered list 

c. get Calls Missed list 

2. read/write Phonebook data 

3 . read/write voice mail data 

4. read/write greeting message data 

5. read/write progranun^le icon data 
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All required queries (known in advance), are understood by the smart data 
access manner 121, This manager is responsible for keeping track of data storage 
mechanisms in use by the application 1 7. All audio recordings (e.g. greeting 
messages and voice mail messages) are stored as separate disk files. References to 
these files are stored in the databases 120 where needed. 

The call discrimination manager 123 is responsible for determining the call 
type (voice, fax or data modem) of mcoming calls, by means of fax tone detection, 
distinctive ring, caller ID and DTMF detection. The call control manager 1 17 passes 
any required call-specific information to the call discranination manager 123 as it 
becomes available. Once an incoming call has been discriminated, the call 
discrimination manager 123 informs the call control manager of the result If the call 
is a fex or data modem call, the call control manager 1 1 7 attempts to pass it to an 
application that can handle it (using the phone manager 115). 

The registry manager 125 provides an interfece to the Windows 95® registry. 

The configuration manager 127 is responsible for maint aining application 
configuration infomiation and user preferences on the basis of user input via the 
application configuration dialog 89 and phone configuration dialog 9 1 . The 
configuration manager 127 uses the registry manager 125 to read and write the actual 
data. 

The audio conversion m a n a g er 129 supports conversion between the native 
audio format (ADPCM) and the WAVE audio format. The native audio format will be 
used for recordmg and playback performed by the application 1 7. Audio files given to 
or obtained fibm other applications will be in the WAVE audio fonnaL 

The audio I/O manager 13 1 is responsible for audio file input and output It 
understands the native format used internally for play and record operations. 



The media message control manager 133 is responsible for: 
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I. recording and playing greeting messages 
n. recording and playing voice mail messages 
m. playing the phone ringing sound 

The call control manager 117 notifies the media message control manager 133 
when any of the above fanctions need to be performed. 

The diaUing manager 135 is responsible for processing ail dialling requests 
including making calls from the Phonebook, the Ust Number Redial list and the 
Speed Dial list. It also keeps track of all required phone company dialling sequences 
(e.g. 3-way calling and call waiting). 

The remote retrieval manager 137 is in charge of providing all functionality 
that can be accessed remotely. This fimctionaUty consists of: 

I. playing, saving and deleting voice messages, 
IL modifying a greeting message 

According to one embodiment of the invention, the date and time that a voice 
message was received may be made available remotely, utilizing a text to speech 
OCX. 

The voice mail manager 139 is responsible for playing previously recorded 
voice mail messages locaUy, either to the handset 1 1 or to a speaker device. This 
manager uses the smart data access manager 1 2 1 to get voice mail message file names 
and the media message control manager 1 33 to play the messages to the appropriate 
device. 

The Microsoft Exchange® manager 141 provides an interfece to all Microsoft 
Exchange® fimctionality required by the appUcaiion 17. In order for all voice mail 
messages to appear in the Microsoft Exchange® Inbox, this manager adds a message 
to the hibox folder of the user's message store for each voice mail message received. 



22 

As well, when the user wishes to play a voice mail message from Microsoft 
Exchange®, a form application is invoked (as discussed in greater detail herein 
having regard to the Microsoft Exchange UI application 107 which displays controls 
to play, stop, rewind and fast forward the message). 

Since voice mail messages can be played both from the application 1 7 and 
from Microsoft Exchange®, these two jq^piications are synchronized in terms of 
played and deleted messages. If the Phonebook entries of application 17 are to appear 
in the user's default Microsoft Exchange® address book, the Microsoft Exchange® 
manager 141 ensures that the Phonebook and address book are kept in sync. 

In order to better understand how the application 17 and engine components of 
core 27 function, several call scenarios are described herein below with reference to 
the first embodiment of the invention, although an understanding of the second 
embodiment will also be obtained therefrom. 

A. Incoming Call 

When an incoming caU is received, TAPLDUL 31 sends a message to the line 
manager 1 13 for each ring. This notification is forwarded to the call control manager 
1 1 7. On the first ring, the line manager 1 1 3 creates a new caU object using the caU 
manager 1 1 1 and the call control manager 1 17 notifies the main window component 
83 of the incoming call. In response, the main window 57 displays the incoming call 
status as shown in Figure lOa wherein defeult button 63 displays a flashing bell icon. 
In Figure 10b, the control bar 79 is shown in the open position for displaying various 
call answer options (other than the default option provided by button 63), while in 
Figure 10c the same options are displayed via the phone menu item of menu bar 67. 

With each ring event, the caU control manager 1 17 causes the media message 
control manager 133 to play a "phone ringing" sound to the appropriate local speaker 
device. If a "caller ID data received" notification is received by the line manager 113, 
the line manager asks the call manager 1 1 1 to store the caUer ID data with the call's 
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object. The call control manager 1 17 then forwards the information to the call 
discrimination manager 123 and the main window component 83. The main window 
component 83 and the directory component 95 search the Phonebook directory for a 
match in stored telephone number with the identified telephone number of the calling 
party. In the event of no match being found, the unaltered CUD data is displayed in 
display area 6 1 (i-e. caller name and telephone number). In the event of a match, the 
caller's name and telephone number are displayed in display area 61 of main window 
57. According to the alternative embodiment, the user's image may also be displayed 
as shown in Figure lOd. 

The call control manager 1 17 uses the smart data access manager 121 to 
determine if the call should be blocked or screened* The resultix^ information is 
stored in the call's object If the call is to be blocked, the call control manager 1 17 
either hangs up on the caller or sends the call to voice mail. 

If distinctive ring data is received by the line manager 1 13, it is stored in the 
call object and forwarded to the call discrimination manager 123. 

With each ring event, the line manager 113 asks TAPI 31 for the answer ring 
count for the given line. If voice mail is tumed on (which is determined from the 
configuration manager 1 27), after the required mmiber of rings have occunred, the line 
manager 113 answers the call. The call control manager 117 then sends the call to 
voice Ttifltl^ and forwards the information to the main window component 83 for 
display via display area 61 of main window 57, as shown in Figures 11a, lib and 11c 
(wherein reference number 143 repr esents die Phone menu choice display from menu 
bar 67). 

If a call is sent to voice mail, the call control manager 1 17 gets the file name 
of the greeting to be played to the caller from the smart data access manager 121. 
This can be done using caller ID. The call control manager 1 1 7 also obtains the name 
of a file to which the voice mail message can be saved. The two file names are then 
passed to the media message control manager 133. This manager first plays the 
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greeting to the appropriate line device. Once the greeting playback has finished^ it 
plays a "beep tone'^ sound to the line device. Once this sound has finished playing, 
recording starts. When recording has finished, the call control manager 1 1 7 asks the 
media message control manager 133 to stop recording. At this point, the call control 
m a nag er 1 1 7 sends the voice mail message data to the smart data access manager 121 
which stores it, and the phone manager 1 15 causes the lamp 16 to flash at telephone 
set 1. 

If the user has fax software running on computer 7, the phone manager 115 
causes lamp 1 6 to flash upon receipt of an incoming &x. Similarly, it is contemplated 
that the lamp 16 may be caused to flash upon receipt of an incoming email message, 
or any multimedia message received via the computer 7. 

If the user picks up the telephone handset or depresses the default button 63 
while the call is in voice mail (Figure 12a), the call is taken out of voice mail and put 
in conversation mode (Figure 12b). If a voice mail message was in the process of 
being recorded, the voice mail data is sent to the smart data access manager 121. 

If the user requests to divert the call to "Hold" and play the "Please Wait" 
message (e.g. by depressing the "Hold" function button 8 1 (Figure 10b)) , the call 
control manager 1 17 asks the line mtanager 1 13 to put the call on hold Then the call 
control manager 1 17 sends a request to the media message control manager 133 to 
play the "Please Wait" message. The call control manager 1 1 7 also send this 
information to main window component 83 which causes the icon 144 for default 
button 61 to change to "Retrieve from Hold" (Figure 13) and to display an "On Hold" 
message and hold timer 1 45. 

When the user hangs-up the handset 1 1 or presses the "Hang Up" icon in 
de&ult button 61 to complete the call (Figure 14a), call control ^aii manager 117 
advises main window component 83 which generates a "Hanging Up*^ message 147 in 
display area 61 (Figure 14b), and also retrieves the call data from the line manager 
113 and passes it to the smart data access manager 121 which creates a call log entry 



(described in greater detail below). Then the call object is deleted and call control 
manager 1 17 advises window component 83 which displays the idle sute of window 
57 with a "Your Line is Free" message 149 in display area 61 (Figure 14c). 

B. Outgoing Call 

Outgoing calls can be initiated in a number of ways, such as direct dial, store 
and dial, look-up name, speed dial and drag & drop name into the name field of 
display area 61, as discussed in greater detail below. 

The user can dial directly from the telephone set 1 by cither first picking up 
the handset 1 1 or pressing a speaker key to obtain dial tone and then dialling the 
phone number normally via the keypad 13. The user can also directly dial from 
application 17 , as shown in Figures 15a to I5d. From the idle state (Figure 15a), the 
user clicks the "Make a Call" icon displayed in defeult button 63, In response, the 
main window component 83 sends a request to the dialling manner 135 to select a 
line. Upon selecting the line, dial tone is generated for the user and the call control 
manager 1 1 7 sends a message to main window component 83 for causing a cursor to 
flash in the **Number'' field 151 of display area 61 (Figure 15b). 

As digits are entered from the keypad 13 or keyboard 12 (Figure 15c), DTMF 
tones are generated and the dialling manager 135 constructs the relevant dial string 
and then asks the line manager 113 for a dialling prefix. Ifthe user v^shes to make a 
private call, the appropriate dialling characters are inserted into the dial string. If the 
digits entered match a Phonebook entry, the name of the person beix% called is 
displayed m the **Name" field 153 of display area 61 and the call timer 155 is 
displayed (Figure 1 5d). The dial string (an4 if known, the name of the person being 
called) is then passed to the line manager 1 13 which creates a call object and initiates 
the call. 

The user can also enter a phone number while on-hook, before out-pulsing the 
digits, as shown in Figures 16a to 16e. From the idle state (Figure 16a), the user 
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"^clicks" the Number field 151. The ciirsor then flashes in the Number field 1 5 1 and 
the user begins entering digits (Figure 1 6b). As digits are entered, if a match is found 
in the Phonebook, the name of the person being called is displayed in the Name field 
153 (Figure 1 6c) along with any label associated with the number (e.g. "Home'\ 
"Office"). Then the user clicks the "Make a Call" icon appearing in default button 63 
, or hits the "Enter'' key since the default button 63 is in "focus", in response to which 
the line is selected and the digits are out-pulsed (Figure 16d), via appropriate 
interaction between line manager 113 and dialling manager 135, as discussed above. 
After dialling has been completed, the call timer 155 is displayed (Figure 16e). 

The user can look-up a person by name without having to ^pen the 
Phonebook. This calling sequence is shown in Figures 17a to 17f: From the idle state 
(Figure 1 7a), the user "clicks" the Name field 153. The cursor tlien flashes in the 
Name field 153 and the user begins entering letters of the name of the person to be 
called (Figure 1 7b). As letters are entered, the Phonebook is searched for matching 
names, the *found" portion of a matched name is then highlighted in the Name field 
1 53, and a de&ult phone number for the entry is displayed in the Number field 1 5 1 
(Figure 1 7c). The user can select a different phone number for the person being 
called, from a drop-down list 1 57 activated by clicking on the down arrow at the right 
of the Number field 151 (Figure 17d). Once the desired number is selected and 
displayed in the Number field 1 5 1 (Figure 1 7e), the user clicks the "Make a Call" 
icon in definilt biitton 63 or hits the "Enter** key to select the line and begin digit out- 
pulsing, as described above. After dialling has been completed, the call timer 1 55 is 
displayed (Figure 17f). 

Using speed dial, a user can quickly access a list of important or frequently 
called persons, without having to search the Phonebook, as shown in Figures 1 8a to 
1 8d. From the idle state (Figure 1 Sa), the user selects the "Dial "menu item from 
menu bar 67. From the "Speed Dial" list (Figure 18b), a name and preferred number 
are selected. The selected name and number are displayed (Figure 1 8c), a line is 
selected and out-pulsing begins as described above, and the default button 63 changes 
its icon to "Hang Up". Once the diaUing is complete, the call timer 155 starts (Figure 
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18d). 



According to another feature of the present invention, the user can drag and 
drop (i.e. cut and paste) text from another appUcation in order to make a call or 
perform a search. Thvs. from the idle state (Figure I9a), the user can highlight a 
portion of text 159 (usuaUy a person's i«me) from another application which supports 
drag and drop functionality (e.g. word processor, spreadsheet, Microsoft Exchange®, 
etc ). and drag the text out of the appUcation and into window 57. As the user drags 
the text over the Name field 153, a drop symbol 161 appears mider the mouse pointer 
(Figure 19b). Upon dropping the text in the Name field 1 53, the Phonebook is 
amomaticaily searched and in response to a match the defeult number associated with 
the matched name is displayed in theNumber field 151 (Figure 19c). By clicking on 
the defiiuit button 63 or hitting the "Enter" key. a line is selected and digit out-pulsing 
begins as de^bed above (Figure 19d). Once the dialling is complete, the call timer 
155 starts (Figure I9e). 

Once the user has completed the calU the handset 1 1 can be remmed to its 
cradle or the user can press the speaker key on telephone set I. The user can also 
hang-up from main window 57 by clicking on the "Hang Up" icon of defeult button 
63 or hitting the "Enter" key (Figure 20a). While discomiecting, the line status 
displays the "Hanging Up' message 147 (Figure 20b), and finaUy the display rettims 
to te idle state (Figure 20c). MeanwhUe, the call conttol manager 1 1 7 gets the caU 
data from the line manager 1 13 and passes it to the smart data access manager 121 

wiiich creates a caU log entty. Then the call object is deleted. 

C. Conversation Modes 

When the user is in a conversation with another party, the caU can be in the 
following states: 

I. handset conversation 

n. speaker phone conversation 



m. on hold 



28 



When the user wish es to switch between conversation modes, the main 
window component 83 sends a request to the call control manager 1 17. The call 
control manager forwards ttie request to the line manager 113 which updates the call 
object's call state to the appropriate conversation mode. 

Central Office 3-Way ^Call 

When the user wishes to initiate a 3*way calU the main window manager 83 
sends a request to the dialling manager 135. The connection with the first party is 
established as described in the ^Outgoing call" section appearing above. When the 
required call progress event(s) are received by the call contml manager 1 1 7, the call 
control manager obtains the dial string required to call the third party from the 
dialling manager 135 and requests the line manager 1 13 to dial. When the next 
required call progress event(s) are received, the call control manager 117 obtains the 
dial string required to cozmect the three parties and sends it to the line manager 113 
for dialling. 

E. CaU Waiting 

The main window manager 83 sends requests to switch between calls to the 
Hiallipg manager 135. The dialling manager then sends the appropriate dial strings to 
the call control manager 1 17 which forwards them to the line manager 113 for 
dialling. 

F. Extension In Use Detection 

According to another aspect of the present invention, if another extension on 
the line with which the application 17 is associated is taken off-hook, the phone 
manager 1 1 5 is informed. In response, the phone manager notifies the call control 
manager 1 17 which modifies the line's state using the line manager 1 13 and forward 
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the notification to the main window manager 83. The main window manager then 
causes the main window to display an in use state indicator in display area 61, as 
shown in Figure 21. 

G. Adding a Person to Phonebook and Opening Profile 

The user can add a caller or called party to the Phonebook, including CUD 
infoimation. From the comiected state (Figure 22a), the user loUs the mouse pointer 
10 over the control bar acmaior 65 (or, alternatively enters Alt + M on the keyboard 
12), which causes the control bar 79 to appear (Figure 22b). The user then clicks on 
the'"Add to Phonebook" icon in function button 8 1 , which causes the Phonebook 
window 163 to open to a "New Entries" display (Figure 22c). thereby presenting the 
user withaUst of new entries includmg the entryforthe connected party 165 which is 
highUghted. The "New Entries" display is indicated as being open at the directories 
display appearing on the left side of window l63.The main window 57 remains in the 
backgroimd. 

Within the Phonebook window 163, the user can move or make copies of 
entries by dragging entries from one list to another using the mouse pointer 10, or can 
search for entries using a "Find" command in the Tools menu of menu bar 164. 

From within the Phonebook window 163. the user can access a profile for any 
entry by cUcking the "open profile" button 167. InitiaUy. the profile window 169 
opens with the "Notes" tab 1 71 open (Figure 22d). thereby presenting the user with a 
Ust of notes (including sound files) relating to that person. However, by cUcking on 
the appropriate tab the user can also open the Work tab (Figure 23 a). Home tab 
(Figure 23b), Phone tab (Figure 23c), Personal tab (Figure 23d) or Shortcuts tab 
(Figure 23e). 



The directory component 95. uses the smart data access manager 121 to add, 
I, read and modify data accessible from the Phonebook (including the profile). 
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H. Retrieving a Message 

The user can retrieve any new voicemail message from the main window 57, 
which provides an indication of the presence of waiting voicemail by the flashing 
icon 75 (Figure 24a) and a tool tip indicating the number of messages when the mouse 
pointer 10 passes over the icon 75 (Figure 24b). A right click on the mouse pointer 10 
when positioned over the icon 75 opens a shortcut menu 1 72 for opening the Call Log 
(Figure 24c) to play the messages. To display the Call Log (as well as the Redial list, 
the Calls Missed list or the Calls Answered list), the main window component 83 
requests the required information from the smart data access manager 121 . Call log 
window 1 73 opens over the main window 57 and vkdthin a Voicemail subdirectory of 
the Calls Received directory displays the stored voicemail messages (Figure 24d). 

Double clicking on the message icon 1 75 opens a recorder window 1 77 for 
automatically playing the voicemail message. Audio recording and playback requests 
from the user inter&ce are sent to the smart data access manager 121 which returns an 
audio file ID. Requests to pause, stop, play, rewind, fast forward, etc. the media 
stream are sent to the media message control manager 133 using the audiofile ED. 

I. Customized Diallers 

According to another aspect of the invention, customizable diallers are 
provided via the software application 1 7 for allowing the user to create multiple 
unique dialling sequences which can be implemented during a single telephone calL 
This is particularly useful for navigatiz^ automated answering and infomiation 
systems such as voice mail, telephone help lines, etc. 

With reference to Figures 25a through 25d, various window displays are 
provided showing operation of the diallers feature according to the first embodiment. 
In Figiue 25a, the dialler feature is shown being accessed via the Tools menu 74 of 
main window 57. As shown in Figure 25b, the dialler window 1 79 comprises a series 
of user defined categories or sections 181 of telephone numbers, office extensions or 



31 



access codes, etc. By clicking on any section 1 8 1, the section may be opened or 
closed, while a right click on the mouse opens a menu for editing, opening/closing, 
etc. Figure 25c shows a particular section 181 (i.e. "Citizen info Line") in the open 
state. As indicated above, a double click on the name of the section closes it again. In 

5 the open state focus is initially on the first of a plurality of user buttons 1 83 . By 

cUcking on the focussed button or pressing die Enter key on keyboard 12, the number 
associated with the button is diaUed and focus shifts to die next button. Each dialler 
button 1 83 can start a new call, continue a call in progress, or bang up. Standard 
modem dialler modifiers of the modem 23 are used to insert pauses, wait for dial tone, 

10 hookflash, etc., in a weU known manner. In this way, a user is able to navigate 

tiirough a complex series of dialling sequences vwthout being required to memorize 
die sequence or wait for on-line instructions. As shown in Figure 25d, any button can 
be edited by effecting a right mouse click when die cursor is over the desired button 
1 83. Likewise, a category or section 1 8 1 can also be renamed, deleted or added. 

15 

With reference to the alternative embodiment of Figures 5a though 5c above, 
the receptionist icon 73 was disclosed as providing access to a plurality of call 
features such as call screening. caU blocking, greetings and personal messages. Upon 
clicking the receptionist icon 73, a "Personal Assistant" window 1 85 is displayed as 
20 shown in Figures 26a though 26d. The Personal Assistant window 1 85 includes a 

pluraUty of tabs identified as CaU Screening (Figure 26a), CaU Blocking (Figure 26b), 
Greetings (Figure 26c) and Personal Messages (Figure 26d). The fimctionality of each 
of these features is described within die window tabs of Figures 26a though 26d. 

25 In Figures 27a through 27f, a configuration window 1 87 is shown having 

multiple user selectable tabs for configuring the phone 1 and application 17. This 
window is generated by the application configuration dialog 89 and phone 
configuration dialog 91 discussed above, and is launched from the Option menu 
selection fiom Tools menu 57 (Figure 25a). 



30 



With reference to Figure 27a, a Sounds tab 1 89 is provided to enable the user 
to customize up to three different ring styles for the telephone set I and to assign 



predetermined sounds to call states such as 'Answering to Hold", "Music on Hold", 
"Hold Reminder'' and "Start recording beep'\ A Sounds button 190 causes a Sound 
Manager window to open, as shown in Figure 28, 

With reference to Figure 27b, an Incoming Calls tab 191 is shown for 
specifying whether the first ring should be silenced, how the ring should be generated 
, auto*answering options and automatic launching of application 17 and opening of 
contact profile based on CUD. 

Figure 27c shows the Audio Devices tab 193 for specifying whether the 
telephone set 1 or computer 7 are used for recording and listening to sounds and 
messages. 

In Figure 27i a Function Buttons tab 195 is shown which allows the user to 
assign functions to the progranunable function keys 15. The user can assign either a 
special fimction, a speed diaU or a combination of both, to the keys 1 5. A designation 
Card portion 196 of the window is used to print an overlay card for identifying the 
fimctions/speed dials assigned to the various keys 1 5. As shown, the user can select 
the font, font size, printer and can then depress a Print Card button 198 which causes 
the card to be printed with the selected functions/speed dials appearing thereon. 

Figure 27e shows the Voicemail tab 197 for configuring voicemail recording 
and retrieval features. 

Figure 27f shows the Miscellaneous tab 199 for configuring various telephone 
and application preferences. 

As disctissed briefly above, various sounds may be recorded and assigned to 
accompany predetermined functions. Figure 28 shows a Sound Manager window 201 
for effecting such sound recording and editing, with available sounds being selected 
&x>m a drop-down list A sounds button 190 appears in each window in which the user 
is permined to select a sound (e.g. the Sounds tab of Figiu^ 27a), the depression of 
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which causes the Sound Manager window 201 to appear. 

The above call scenarios are of an exemplary nature for describing how the 
application 1 7 and engine components of core 27 fiinction, and are not intended to be 
exhaustive. Numerous other call scenarios are supported by the fimctionality set forth 
herein. 



CLAIMS: 
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1 . A computer-based telephony system, comprising: 

a telephone set for implementing telephony functions on a telephone line, said 
telephone set including a serial interface for bidirectional communication of data 
signals; and 

a computer executable software application for receiving first ones of said 
data signals from said telephone set and in response implementing predetermined 
software functions, and for transmitting further ones of said data signals to said 
telephone set in response to a user input whereupon said telephone set implements 
predetermined ones of said telephony functions. 

o 

2. The computer-based telephony system of claim I, vidierein said computer 
executable software application generates and displays a window including an area 
for indicating telephone call status responsive to one of either user input or receipt of 
said first ones of said data signals, and context sensitive buttons for initiating one or 
more of said telephony fimctions which are appropriate to said telephone call status. 

3 . The computer-based telephony system of claim 2, wherein at least one of said 
buttons is a de&ult button adjacent said area for indicating telephone call status, said 
de&ult button being provided for user initiation of a preferred one of said telephony 
functions which is appropriate to said telephone call status. 

4. The computer-based telephony system of claim 3, wherein said window 
includes a control bar of further ones of said buttons which are sequentially airanged 
adjacent said de&ult button for user initiation of respective further ones of said 
telephony functions which are appropriate to said telephone line status. 

5. The computer-based telephony system of claim 3, wherein said de&ult bunon 
has focus in said window such that said preferred one of said telephony functions may 
be initiated by pressing an Enter key on a computer executing said application. 
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6. The computer-based telephony system of claim 4, wherein said control bar is 
generated and displayed only in response to a prcdeteimined user input 

7. The computer-based telephony system of claim 2, wherein said context 
sensitive buttons are identified by labels including at least one of an icon or text for 
describing said telephony functions which are appropriate to said telephone call 
status. 

8. The computer-based telephony system of claim 2, wherein said window 
includes a status line having icons for mdicating predetermined ones of said telephony 
fijnctions which have been implemented. 

9. The computer-based telephony system of claim I, wherein said telephone set 
includes a plurality of user programmable functions keys, and wherein said computer 
executable software appUcation (I) generates and displays a window including an area 
depicting said user programmable function keys and a menu associated with each of 
said depicted programmable fimction keys, said menu containing a plurality of user- 
selectable ones of said predetermined software fimctions and said telephony fimctions 
to be assigned to respective ones of said programmable fiinction keys, (ii) transmits 
predetermined fijrther ones of said data signals to said telephone set in response to 
user selection of said predetermined software fimctions and said telephony fimctions 
whereby said telephone set assigns said ptedeterminedi software fimctions and 
telephony functions to respective ones of said user programmable function k^ on 
said telephone set, and (iii) prints an overlay card listing each one of said 
predetermined software functions and telephony functions assigned to respective ones 
of said user programmable fiinction keys for placement on said telephone set 

10. The compi«er-based telephony system of claim 2, wherein said computer 
executable software application m*^"***"^ a phonebook database and generates and 
displays a phonebook window including an area for indicating names and defeult 
telephone numbers of ftequentiy called persons and a button for initiating a call to a 
selected one of said persons. 



1 1 . The computer-based telephony system of claim 10, wherein said computer 
executable software ^plication generates a profile window associated with each of 
said ftequentiy called persons, for each of said persons said profile window including 
a graphic image of that person, the person's first and last name, and a plurality of 
selectable tabs for selectively displaying additional information concerning the person 
and options for automatic implementation of selected ones of said predetermined 
telephony functions and predetermined software functions. 

12. The computer-based telephony system of claim 1 1, wherein one of said 
plurality of selectable tabs is a notes tab for displaying texttial notes and icons for 
initiating playback of sound files associated with said person. 

13. The computer-based telephony system of claim 1 1 , vslierein one of said 
plurality of selectable tabs is a work tab for displaying fiill work address for said 
persotL 

1 4. The computer-based telephony system of claim 1 1 , wherein one of said 
plurality of selectable tabs is a home tab for displaying a fiill home address for said 
person. 

1 5. The computer-based telephony system of claim 1 1 , wherein one of said 
plurality of selectable tabs is a phone tab for displaying a pluraUty of telephone 
numbers associated with said person in addition to the defeult telephone number for 
said persoiL 

1 6. The computer-based telephony system of claim 1 1 , wherein one of said 
plurality of selectable tabs is a tab for customizing greetings to be played when said 
person calls. 

1 7. The computer-based telephony system of claim 1 1 , vv^crein one of said 
plurality of selectable tabs is a shortcuts tab containing a field for displaying icons 
representing additional software applications which can either be automatically 
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executed in response to one or both of calls being placed lo said person or received 
from said person or manually executed by mouse clicking on said icons. 

18. The computer-based telephony system of claim 2, wherein said window 

5 fijither includes an information display area for displaying name, telephone number 

and graphic image of a called or calling party. 

19. The computer-based telephony system of tlaim 18, wherein said computer 
executable software application maintains a phonebook database including said name. 

10 telephone number and graphic image, and automaticaUy searches said database in the 

event of an incoming call containing caller line identification data for a match 
between said caller line identification data and said telephone number and in the event 
of a match automaticaUy displays said name, telephone number and graphic image in 
said display area of said window. 



15 
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20. The computer-based telephony system of claim 1 , whercin.said computer 
executable software appUcation includes a user customizable dialler for dialling a 
plurality of numbers associated with a user defined category in accordance with a user 
selected dialling sequence. 

21. The computer-based telephony system of claim 20, wherein said computer 
executable software appUcadon displays a window showing a user selected name for 
each said category and a pluraUty of buttons each with a user selected label. 

22. A ocmputfir based tel^*iony system substantially as 
he^eiJibefore described with reference to the accarpanying dravdngs. 
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